Constraining the mass of the graviton using coalescing black-hole binaries 



D. KeppeE and P. Ajitlfl 
LIGO Laboratory, California Institute of Technology, Pasadena, CA 91125, USA and 
Theoretical Astrophysics, California Institute of Technology, Pasadena, CA 91125, USA 

We study how weU the mass of the graviton can be constrained from gravitational- wave (GW) observations of 
coalescing binary black holes. Whereas the previous investigations employed post-Newtonian (PN) templates 
describing only the inspiral part of the signal, the recent progress in analytical and numerical relativity has 
provided analytical waveform templates coherently describing the inspiral-merger-ringdown (IMR) signals. We 
show that a search for binary black holes employing IMR templates will be able to constrain the mass of the 
graviton much more accurately (~ an order of magnitude) than a search employing PN templates. The best 
expected bound from GW observatories (Xg > 7.8 x 10^^ km from Adv. LIGO, > 7. 1 x 10^^ km from Einstein 
Telescope, and A^>5.9xl0^^ km from LISA) are several orders-of-magnitude better than the best available 
model-independent bound (A^ > 2.8 x 10^^ km, from Solar system tests). 
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I. INTRODUCTION AND SUMMARY 

General relativity (GR) has proven to be very successful in 
predicting and explaining a variety of gravitational phenom- 
ena. Over the last century, basic ingredients of GR have been 
tested in many different ways and in many different settings. 
In GR, gravitational interactions propagate with the speed of 
light, which means that the hypothetical quantum particle of 
gravity, the "graviton", has no rest mass. A non-zero graviton 
mass ntg would produce several interesting effects: for e.g., 
it will cause the gravitational potential to take the Yukawa 
form, effectively cutting off gravitational interactions at dis- 
tances greater than the Compton wavelength = h/rrigC of 
the graviton. Indeed, the absence of such effects in the so- 
lar system has provided a lower bound on Ag (hence an upper 
bound on rrig). But a graviton mass with corresponding Comp- 
ton wavelength much larger than the size of the solar system 
has not yet been ruled out in a model-independent wa}0. Also, 
if the graviton has non-zero mass, the gravitational waves 
(GWs) will have extra degrees of freedom (such as longitudi- 
nal modes), and will travel with a frequency-dependent speed, 
different from the speed of light. 

Whereas the current experimental bounds on theories of 
gravity are from the weak-field limit, GW observations pro- 
vide excellent test beds in the dynamical, strong-field regime 
(see 10] and iH] for recent reviews). Indeed, these are ex- 
citing times for the word-wide GW community. The Initial 
LIGO 10] detectors have completed their fifth science run, at 
design sensitivity. The Virgo ^ and GEO 600 detectors ran 
concurrently with LIGO for part of that run. Although a di- 
rect detection of GWs is yet to be made, a number of inter- 
esting astrophysical upper limits are constructed based on this 
data (see e.g., 10, H])- After the ongoing sixth science run at 
a further improved sensitivity, the LIGO-Virgo detectors will 
undergo a commissioning break with the target of achieving 
much improved sensitivities with Advanced LIGO and Ad- 
vanced Virgo. Implementing a number of advanced technolo- 
gies including the use of squeezed light, the GEO 600 is al- 



ready undergoing commissioning work for the high-frequency 
detector configuration GEO-HF 1 8]. Also, the design study for 
a third generation detector, called the Einstein Telescope (ET) 
is ongoing in Europe. With the ever closer approach of the era 
in which GW observations become routine, it is interesting to 
see and update what information could be gathered about the 
Universe from these observations. 

In this paper we investigate the possible bounds that can be 
put on theories with an effective mass in the propagation of 
GWs (massive-graviton theoriefl in short) from GW obser- 
vations of coalescing binary black holes (BBHs). In massive- 
graviton theories, the speed of propagation of GWs depends 
on the wavelength. If the GW emission is accompanied by 
electromagnetic (EM) emission (such as the case of a core- 
collapse supernova or a white-dwarf binary), a bound on the 
mass of the graviton can be placed by comparing the time of 
arrival of the GW signal with the EM signal ifiol] . or, by cor- 
relating the EM and GW signals |[lll - [l3|] . But, since many 
of these sources are not very well understood in terms of 
their emission mechanisms and the delay between EM and 
GW emissions, this could introduce significant uncertainties 
in such measurements. 

Coalescing BBHs provide us with the potential to constrain 
the mass of the graviton without relying on the presence of an 
EM counterpart. In the case of BBHs, since the frequency 
of gravitational radiation sweeps from lower to higher fre- 
quencies, the speed of the emitted gravitons will vary, from 
lower speeds to higher speeds. This will cause a distortion in 
the observed phasing of the GWs. Since BBHs can be accu- 
rately modelled using analytical/numerical solutions of Ein- 
stein's equations, any deviation from GR can be parametrized 
and measured (see, e.g., |^ for a recent discussion on such a 
general framework). A framework for testing this possibility 
by measuring the distortion of GWs was originally developed 
by Will [10]. Will found a dispersive effect that appeared as 
an additional term in the post-Newtonian (PN) expansion of 
the GW phase, and showed that a bound on the mass of the 
graviton can be placed from the GW observations by applying 
appropriate matched filters. 
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^ It has been argued that "dark energy" might be explained by a graviton- 
mass-like effect, with associated Compton wavelength comparable to the 
radius of the visible universe. See [IJ for a review. 



^ It has to be mentioned that so far there is no complete theory of gravity 
in which the graviton can have a mass. Constructing such a theory in a 
ghost-free manner has proven to be nontrivial; see, e.g., 0] and references 
therein. 
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FIG. 1. Left. Top panels show the lower bound on the Compton wavelength Xg of the graviton that can be placed from observations of equal- 
mass binaries located at distances such that they produce optimal SNRs of 10 in the Adv. LIGO (black traces) and ET (grey traces) detectors 
using their smallest low-frequency cutoffs (10 Hz and 1 Hz, respectively). Middle panels show the same bounds from binaries located at 1 
Gpc, and the bottom panels show the optimal SNR produced by these binaries. Horizontal axes report the total mass of the binary. Solid and 
dashed lines correspond to IMR and restricted 3.5PN waveforms, respectively. Right. Same plots for the case of binaries located at 3 Gpc 
detected in the LISA detector. 



Will's original work was performed using restricted PN 
waveforms describing the inspiral stage of non-spinning coa- 
lescing compact binaries, the phase of which was expanded to 
1.5PN order. Recent work has elaborated on this by incorpo- 
rating more accurate detector models, and by including more 
physical effects such as effects rising from the spin angular 
momentum of the compact objects, from the eccentricity of 
the orbit, and from the inclusion of higher harmonics rising 
from the contribution of the higher multipoles lfT4l - [2Qll . 

Since the PN formalism has enabled us to compute accurate 
waveforms from the inspiral stage of the coalescence, these 
analyses have focused on the information gained from the ob- 
servation of the inspiral stage. The last few years have wit- 
nessed a revolution in the numerical simulations of compact 
binaries. In particular, numerical relativity was able to obtain 
exact solutions for the "binary-black-hole problem" ll2ll - [23l] . 
Concomitant with this great leap has been significant progress 
in analytical relativity in the computation of high order PN 
terms and the inclusion of various effects arising from spins, 
higher harmonics etc. Combining the analytical and numer- 
ical results, different ways of constructing inspiral-merger- 
ring-down (IMR) waveforms have been proposed ll24l - [26l] . It 
has been widely recognized that these IMR waveforms will 
significantly improve the sensitivity and distance reach of the 
searches for BBHs (see, e.g., ||2l,|27ll2Sl]) as well as the accu- 
racy of the parameter estimation (see, e.g., IH-Sl]). 

In this paper, we estimate the bounds that can be placed on 
the mass of graviton from the GW observations of BBHs us- 
ing IMR templates. This is motivated by the previous observa- 
tions (see e.g. 1I29I1 ) that the IMR waveforms will significantly 



improve the accuracy of the parameter estimation by breaking 
the degeneracies between the different parameters describing 
the signal, including the parameter describing the mass of the 
graviton. 

Due to the intrinsic randomness of the noise in the GW 
data, the estimated parameters of the binary (including the 
one parameter describing the mass of the graviton) will fluc- 
tuate around their mean values. In the limit of high signal- 
to-noise ratios (SNRs), the spread of the distribution of the 
observed parameters — the accuracy of the parameter estima- 
tion — is quantified by the inverse of the Fisher information 
matrix ll32[]33ll . We employ the Fisher matrix formalism to es- 
timate the expected bounds on the mass of the graviton using 
the non-spinning limit of the IMR waveform model proposed 
by Ref. ll34ll . This is a frequency-domain waveform family 
describing the leading harmonic of the IMR waveforms from 
BBHs. 

Indeed, in the absence of a complete massive-graviton the- 
ory, we consider only the propagation effects of a massive 
graviton, and assume that the wave generation is correctly 
given by GR, apart from negligible corrections. This will in- 
troduce a systematic error on the possible constraints, which 
depends on the specific massive graviton theor}0. Since we 



^ If stable black holes exist in such theory, then we might expect that the 
major effect comes from the propagation, since the length scales involved 
in the propagation are typically much larger than the length scales involved 
in the wave generation. However, it is difficult to address this properly in 
the absence of a complete theory of massive graviton. 
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are neglecting spins and higher harmonics in the (general rel- 
ativistic) signal model, this introduces another set of system- 
atic errors; but these can be circumvented by including these 
effects in the signal model. We remind the reader that this pa- 
per only tries to quantify the noise-limited statistical errors in 
the observations. 

The main findings of the paper are summarized below (Sec- 
tion II Ab . The following sections present the details of the 
analysis. Section|Illbriefly reviews the effect of massive gravi- 
ton on the dispersion of GWs, and summarizes the existing 
bounds on the graviton mass. In Section |llll we compute the 
expected upper bounds that can be placed on the mass of the 
graviton using the observations of IMR signals. In that sec- 
tion, we review the signal and detector models used, provide 
the details of the computation and present a discussion of the 
results and the limitations of this work. 



A. Summary of results 

An executive summary of results is presented in Fig. [T] 
for the case of ground-based detectors Adv. LIGO and ET 
as well as the space-borne detector LISA. Eor ground-based 
detectors, the binary is assumed to be located optimally ori- 
ented at 1 Gpc, and for LISA, the binary is located at 3 
Gpc. Eor the case of Adv. LIGO (with low-frequency cutoff, 
fi^^ = 10 Hz), the best bound (Ag > 7.8 x lO^^km 2.5pc; 
mg< 1.6 X 10-2^ eV) using IMR templates is obtained from 
the observation of binaries with total mass M 36OM0. This 
is significantly better than the best bound obtained using re- 
stricted 3.5PN templates (Ag > 7.9 x 10^^ km for M ISM©). 
Eor ET (with /low = 1 Hz), the best bound using IMR tem- 
plates (Xg > 7.1 X 10^\m 23pc; 1.7 x lO'^"^ eV) is obtained 
from binaries with M ~ 3OOOM0, while the best bound for 
PN templates (Ag > 1 x 10^^ km) is obtained for binaries with 
M c:^ 65Mq. Eor LISA observation of supermassive black-hole 
(BH) binaries, the best bound (Ag > 5.9 x lO^^km 19kpc; 
2.1 X 10~^^ eV) using IMR templates is obtained from bina- 
ries with M :^ 4.8 X lO^M©, while the best bound using PN 
templates (Ag > 6.3 x 10^^ km) is obtained from binaries with 
M 1.9 X lO^M©. In summary, the best bounds using IMR 
templates are roughly an order of magnitude better than the 
best bounds using restricted PN templates. The improvement 
is partly due to the higher SNR and partly due to the extra 
information harnessed from the post-inspiral stages. 

The best expected bound from ground-based observatories 
is over two orders-of-magnitude better than the best avail- 
able model-independent bound (Ag > 2.8 x 10^^ km) given 

Addition- 



by monitoring the orbit of Mars (see Sec. IIIBI) 
ally, LISA will be able to improve on those bounds by sev- 
eral orders of magnitude. Most importantly, GW observations 
will provide the first constraints from the highly dynamical, 
strong-field regime of gravity. Table J] summarizes the bounds 
that can be placed with future GW observations employing 
different signal models / analysis methods. 

Effect of low frequency cutoff: — The best bound that can be 
placed with Adv. LIGO noise spectrum with low-frequency 
cutoff, /low = 10 Hz will be ~ 25% better than the same ob- 
tained with /low = 20 Hz. Eor ET, the best bounds using a 
configuration with /ow = 1 Hz is ~ 70% better than the same 



obtained with /ow = 10 Hz. We hope that this information can 
contribute to weighing the scientific case of different configu- 
rations of advanced detectors. 

Detectability of the signals by GR-based templates: — If we 
assume the constraints on the graviton mass given by solar 
system tests, the "mismatch" between the signal and GR- 
based templates is unacceptably high (7-50%). However, if 
the mass of the graviton is a factor of three smaller than the 
solar system limit, then the mismatch is negligible. This pro- 
vides a rough estimate of the detectability of the deformed 
signals (due to the graviton mass) using GR-based templates. 



Signal model / method 



1.5PN inspiral |10] 

1.5PN inspiral, more 
accurate detector model fTJ 

3.5PN inspiral, no spin 
[this paper] 

3.5PN inspiral, higher 
harmonics, no spin (20ll 

3.5PN inspiral, 2PN spin, 
no precession jlSiil 

2PN inspiral, spin 
precession nm 

2PN inspiral, simple spin 
precession, eccentricity IToll 

IMR, no spin [this paper] 

Measuring phase of arrival 
of diff. harmonics from 
eccentric binaries 116(1 

Correlating GW and EM 
observations from white 
dwarf binaries [12] 

Correlating GW and EM 
observations from 
supermassive BH 
binaries IT3I1 



Adv. LIGO ET 



LISA 



0.6 (20) 



0.7 (2x 10^) 



0.5 (100 

0.8(18) 10(65) 0.6(1.9x106) 

0.7 (60) 10 (400) 0.5 (2 x 10^) 

0.5 (2 X 10^) 

0.7 (2 X 10'^) 

0.4 (10^) 

8 (360) 70(3000) 6(4.8 x10^) 
0.3 (10^) 

10-^ (2.8) 

9x 10-2 (10^) 



TABLE I. Expected bounds on kg (in units of 10^^ km for the case 
of Adv. LIGO and ET, and lO^'^ km for LISA) to one significant digit 
using future GW observations employing different signal models / 
analysis methods. Total mass (in Mq) giving the bound are shown 
in brackets. It should be noted that different investigations have used 
slightly different source- and detector models, and hence, are not 
strictly comparable. 



II. DISPERSION OF GRAVITATIONAL WAVES AND THE 
EXISTING BOUNDS ON THE MASS OF THE GRAVITON 



A. Dispersion of gravitational waves 

Will 1^10'] derived the dispersive effects of a massive gravi- 
ton on the propagation of GWs from coalescing compact bi- 
naries. If the gravitons are massive, the GWs will travel with 



4 



a speed Vg different from the speed of ligh^ given by 



v' = \-m'/E' = \-{Xj)-\ 



(2.1) 



where nig is the graviton rest mass, Eg its rest energy, Xg = 
Mg^ its Compton wavelength, and / is the frequency of 
the gravitational radiation. Consider two gravitons with fre- 
quency fe and fl emitted in the time interval A^^ at the source. 
The dispersion relation given in Eq. (l2.1l) will change this time 
interval to 



= (1+Z) 



Al 



D 

\fi f'^ 



(2.2) 



when observed from a distance D. The distance parameter D 
is related to the luminosity distance Dl by 




10^ 10^ 
Total Mass (M©) 



D = Dl 



i + (2+z)(i+z+vTTz) 



5(1+Z)2 



(2.3) 



where Z is the cosmological redshift. Such a change in the 
arrival time will lead to a distortion of the observed phasing 
of the GW signal at the detector, as described by Eq. (l3.3l) . 



FIG. 2. Optimal SNR (lower panel) and the lower bound on the 
Compton wavelength Xg of graviton (upper panel) for IMR wave- 
forms detected at 1 Gpc by the Adv. LIGO detector. Black and grey 
curves correspond to low-frequency cutoffs 10 Hz and 20 Hz, re- 
spectively, while solid, dashed, and dotted curves correspond to mass 
ratios T] = 1/4, 2/9 and 4/25. 



B. Existing bounds on the mass of the graviton 

The most stringent available bound on the mass of the 
graviton (which does not rely on specific massive-graviton 
theories) comes from the effect of a massive graviton field 
on the static (Newtonian) gravitational potential, changing it 
from M/r to the Yukawa form Mr~^e~^^^s . If this were the 
case, Kepler's third law would be violated since the gravita- 
tional force would no longer follow an inverse- square law. 
The absence of such an effect in the solar system thus pro- 
vides an upper limit on the graviton mass. The most stringent 
bound comes from the orbit of Mars which limits the mass of 
the graviton such that Xg > 2.8 x 10^^ km. |[35ll . 

Another, slightly less sensitive, bound is given by the bi- 
nary pulsar observations. If the graviton had mass, the orbits 
of binary pulsars would decay at a slightly faster rate than pre- 
dicted by GR, due to additional energy loss from the leading 
order massive graviton terms in the power radiated. Combin- 
ing the observations of PSR B1913+16 and PSR B1534+12, 
Ref. S obtained the 90% confidence bound > 1.6 x 10^^ 
km. 

A number of model dependent, albeit more sensitive 
bounds have been constructed by invoking assumptions such 
as specific massive-graviton theories and specific distributions 
of dark matter. For a summary of such results, we refer the 
reader the recent review fl] . 



III. EXPECTED BOUNDS ON THE MASS OF THE 
GRAVITON USING INSPIRAL-MERGER-RING-DOWN 
WAVEFORMS 

A. Signal model 

The (general-relativistic) signal model we use is the non- 
spinning limit of IMR waveforms describing BBHs with non- 
precessing spins, proposed by Ref. |[34ll . These frequency- 
domain waveforms can be written as h{f) = A(/)^^^(^\ 
where the amplitude and phase are given by 



-7/6 



f /-'/'(l+lL^^-vO if/</i 

^m/-'/' (1 £.-vO if /l < / < /2 



W,^(/,/2,CT) 





if/2</</3 

if/>/3, 



^(/)=2;rA + (Po- 



1287]v- 



(3.1) 



k=2 



Throughout the rest of this paper, we use geometric units: G 



In the above expressions, f = f / f\ and v = {TtMfY^^, 
where M = mi -\- m2 is the total mass of the binary, and 
T] = m\m2/M^ is the symmetric mass ratio. For non-spinning 
binaries, the PN corrections to the Fourier domain ampli- 
tude of the (^ = 2,m = ±2 mode) PN inspiral waveform are 
a2 = -323/224 + 451 T7/I68 and as = |137|l, while the phe- 
nomenological parameters describing the merger amplitude 
take values £\ = —1.8897, £2 = 1.6557. C is a numerical con- 
stant depending on the location and orientation of the binary, 

as well as the masses: C = ^^2/3 optimally-oriented 
binaries, Dl being the luminosity distance. The time of ar- 
rival of the signal at the detector is denoted by to, the corre- 
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spending phase by 90, and ^{fj2,a) = ^ (/_/^p+^2/4 is 
a Lorentzian function with width a centered around the fre- 
quency/2. 

For these waveforms, the ampHtude of the "inspiral" part 
is described by the ampHtude of the PN inspiral wave- 
form and the ampHtude of the ringdown portion is mod- 
eHed as a Lorentzian, which agrees with the quasi-normal 
mode ringing of a perturbed BH from BH perturbation the- 
ory. The merger amplitude is empirically estimated from 
the numerical-relativity simulations. The frequencies /i and 
/2 correspond to the transition points between the inspiral- 
merger and merger-ringdown, and is a convenient cutoff 
frequency such that the signal power above this frequency is 
negligible. The normalization constants Wm and Wr make A(/) 
continuous across the transition frequencies /i and /2. 

The phase of the waveform is written as an expansion in 
terms of different powers of the Fourier frequency / (analo- 
gous to the phasing expression of the PN inspiral waveform 
computed using the stationary-phase approximation). But the 
phenomenological phase parameters Xj/k are tuned so that the 
analytical templates have the best overlaps with the complete 
IMR waveforms. Thus, Xf/^ are different from the correspond- 
ing coefficients describing PN inspiral waveforms. This also 
restricts the validity of these waveforms to the range of GW 
frequency / > 2 x 10~^/M. In this paper, we only consider 
binaries with total mass M > 2 x 10~^//iow, where /low is the 
low-frequency cutoff of the detector sensitivity. 

The phenomenological parameters 1//)^ and flj^ = 
{/i,/2, cr,/3} are written in terms of the physical parameters 
M and r] of the binary as: 



.(10) 



(20)^2^ (30). 



Vk = ¥k^4 ^+4 ^ 



-.f%^+.f^^ (3.2) 



where the coefficients and are tabulated in Table [III 

The effect of a massive graviton is that it will create a dis- 
tortion in the observed phasing of GWs, which can be written 
as liSl 



^eff(/)=^(/)-i3r^ + 0g + %/, 



(3.3) 



where ^(/) is given by Eq. (l3.1l) . The terms involving Tg and 
(j)g will only result in a redefinition of the measured arrival 
time ^0 and the phase offset (po, and hence can not be indepen- 
dently measured. But the term involving j3 = 7ZD/Xg{l +Z) 
will produce an observable effect. In general, j3 will have non- 
zero correlation with other parameters describing the wave- 
form, which will limit our ability to estimate j3 (see Sec lIIIQ . 

For this calculation, we have assumed that the wave gener- 
ation is given correctly by OR. At least for the inspiral por- 
tion of the signal, it is reasonable to expect that corrections 
to GR will be of the of order (r/Ag)^, where r is the size of 
the binary system [fiot] . Assuming the existing bounds on the 
graviton mass {Xg > 10^^ km), it can be shown that, for the 
binaries we are interested in, the correction is negligible. But, 
if the BHs in the true massive-graviton theory is significantly 
different from the BHs in GR, this could affect the wave gen- 
eration in the merger-ringdown stages. Since we do not have 
a complete massive graviton theory, we are unable to address 
this issue at the moment. 
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^(10) 


^(20) 


_^(30) 




3715 
756 


-920.9 


6742 


-1.34x10^ 


W3 


-\6k 


1.702x10^ 


-1.214x10^ 


2.386x10^ 


¥4 


15293365 
508032 


-1.254x10^ 


8.735 xlO^ 


-1.694x10^ 


¥6 





-8.898x105 


5.981 xlO^ 


-1.128x10^ 


¥1 





8.696x10^ 


-5.838x10^ 


1.089x10^ 






ym 


3;(20) 


ym 


fl 


1-4.455 + 3.521 


0.6437 


-0.05822 


-7.092 


fl 


(l-0.63)/2 


0.1469 


-0.0249 


2.325 




(l-0.63)/4 


-0.4098 


1.829 


-2.87 


h 


0.3236 


-0.1331 


-0.2714 


4.922 



TABLE II. Coefficients describing the analytical IMR waveforms 
(see Eq. 0.21 )) in the non- spinning limit. 
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FIG. 3. Optimal SNR (lower panel) and the lower bound on the 
Compton wavelength Xg of graviton (upper panel) for IMR wave- 
forms detected at 1 Gpc by the ET detector. Black, dark grey and 
light grey curves correspond to low-frequency cutoffs 1 Hz, 5 Hz, 
and 10 Hz, respectively, while solid, dashed, and dotted curves cor- 
respond to mass ratios T] = 1/4, 2/9 and 4/25. 



B. Detector models 

Assuming that the detector noise is zero-mean stationary 
Gaussian, the noise characteristics are completely determined 
by its (one-sided) power spectral density (PSD) Sh{f). 

An analytical fit to the expected noise PSD of Adv. LIGO 
is given in terms of a dimensionless frequency x = f/fo ll38ll : 



Sh{f) = 10- 



-49 



111 



/ l-x^ + xV2 \ 
V l+xV2 / 



(3.4) 

where /o = 215 Hz. For Adv. LIGO, we perform our stud- 
ies assuming two values for the low-frequency cutoff, /low = 
10 Hz and 20 Hz. 
For the ET, the design (including the topology) is not com- 



6 



plete. For simplicity, we take the simplest configuration and 
assume ET to be a single L-shaped interferometer with 10 km 
arms. The envisaged noise PSD ("ET-B sensitivity") of this 
configuration is given by the following fit [39]: 



Shif) = 10- 



-50 



2.39 X 10"^^x"^^-^V0.349x"^-^'^^ 



1.76x-^-^^ + 0.409xi-i]\ 



(3.5) 



where /o = 100 Hz. For ET, we perform our studies assuming 
three different values for /low^ 1 Hz, 5 Hz and 10 Hz. 

For LISA, we use the total effective non-sky-averaged spec- 
tral density, neglecting the signal modulation due to the orbital 
motion of the detector [jlSL 



Shif) = min{^f ^(/)/exp {-KT-'dN/df) . 



nNSA 



{f)+sf{f)} 



(3.6) 



where dN/df = 2 x 10~^^x^^/^ Hz~^ is the number density of 
galactic white-dwarf binaries, /c c:^ 4.5 is the average number 
of frequency bins that are lost when each galactic binary is 
fitted out, and T is the observation time. The instrumental 
contributions are given by. 



nNSA 



(/) 



9.18 X 10"^ W 1.59 X 10"^^ 
9.18 X 10-^ V] , 



(3.7) 



where /o = 1 Hz. The galactic/extra-galactic white-dwarf 
confusion-noise contributions are given by. 



5f (/)= 2.1x10- v/^ 



: 4.2 X lO-'^V^/^ . 



(3.8) 



We start the integration at /low = Hz. Binaries that 
we consider in this paper would spend less than T 
5/256r]M^/^(7r/iow)^/^ - 8 months in the detection band. 



C. Computing error bounds using Fisher information matrix 

Searches for GWs from coalescing compact binaries make 
use of the optimal technique of matched filtering, which in- 
volves cross-correlating the data d with a number of theoreti- 
cal templates h{6^) of the signal waveforms: 



■{d\h) =43i r 

-'/low 



d{f)h*{f)df 

Shif) ' 



(3.9) 



where p is the SNR, tildes denote Fourier transforms, Sk{f) 
is the one-sided PSD of the detector noise, /low the low- 
frequency cutoff of the sensitivity, and h = h/{h\hy^^. 

Owing to the intrinsic randomness of the detector noise, the 
parameters 6^ estimated from the search (parameters of the 
template giving the maximum SNR) will be, in general, differ- 
ent from the "actual" parameters of the source. If the noise 
is stationary Gaussian and if the templates are faithful repre- 
sentations of the true signals, then the errors 50^ = 0^ — i^^ 
will be distributed according to a multivariate Gaussian dis- 
tribution with zero mean, whose spread can be quantified by 
the elements of the variance-covariance matrix Z^^. Specifi- 
cally, the rms error in estimating the parameter 6^ is given by 




10^ 10® 
Total Mass (M©) 



FIG. 4. Optimal SNR (lower panel) and the lower bound on the 
Compton wavelength Xg of graviton (upper panel) for IMR wave- 
forms detected at 3 Gpc with the LISA detector. The solid, dashed, 
and dotted curves correspond to mass ratios rf = 1/4, 2/9, and 4/25. 



A6^ = Vt^. a relation between If^^ and the signal is avail- 
able through the Cramer-Rao inequality IH,!!!!], which states 
that 



where T is the Fisher Information matrix, given by 



^ ab ■ 



dh 



dh 



(3.10) 



(3.11) 



h being the signal waveform, where the inner product is de- 
fined in Eq. (|3.9l ). Th us, a lowe r bound on the expected errors 
is given by: AO^ = ^(r^. 

The parameters used in the Fisher-matrix calculation are 
6^ = {InC, (po, to, InM, lnT7,j3}. The matrix elements are 
computed by analytically computing the derivatives and nu- 
merically evaluating the inner products. The Fisher matrix is 
then numerically inverted to yield the variance-covariance ma- 
trix. The resultant Fisher matrix is well-conditioned through- 
out the parameter space we consider except at the highest total 
masses, where less and less of the signal is in the detectors' 
sensitive bands. 



D. Results and discussion 

An executive summary of results is presented in Fig. [T] 
and Section II Al For ground-based detectors, the binary is 
assumed to be optimally located and optimally oriented at 
1 Gpc, and for LISA, the binary is located at 3 Gpc. For the 
ground-based detectors, we recompute bounds on the mass of 
the graviton for various combinations of mass ratio and low- 
frequency cutoff (see Figs. [2] and [3]). For the LISA detector, 
we duplicate the calculations for various mass-ratio combina- 
tions with a single low-frequency cutoff (see Fig. (4]). 



7 



For the ground-based detectors, one can easily see the effect 
of different low-frequency cutoffs by looking at the SNR pan- 
els of Figs. [2] and m These figures show that at the low-mass 
end, the mass ratio has a stronger effect on the SNR than the 
low-frequency cutoff. This makes intuitive sense since most 
of the power of the signal lies above the highest low-frequency 
cutoff in that regime, thus the variation in low-frequency cut- 
offs doesn't significantly affect the SNR. As the signal moves 
toward higher masses, the bandwidth of the waveform moves 
out of the detectors' sensitive bands and the SNRs rapidly de- 
crease. 

It should be noted that the mass range giving larger bounds 
on Xg need not correspond to the mass range giving the best 
SNR. This bound is sensitive to more than just the power of 
the signal present in the detectors. Additional degeneracy- 
breaking information is present at lower frequencies for a 
given mass signal. Using a smaller lower-frequency cutoff in- 
cludes this information and thus improves the bound we could 
place on the mass of the graviton. 

The best bounds for each combination of mass ratio and 
low-frequency cutoff are summarized in Table |llll The best 
bound that can be placed with Adv. LIGO noise spectrum with 
low-frequency cutoff, /low = 10 Hz will be ~ 25% better than 
the same obtained with /low = 20 Hz. Similarly, for ET, the 
best bounds using a configuration with /low = 1 Hz is ~ 70% 
better than the same obtained with /low = 10 Hz. We hope that 
this information can contribute to weighing the scientific case 
of different configurations of advanced detectors. 



/low 


^ = \/A 


T7=2/9 


T] =4/25 


Adv. LIGO 


10 Hz 


7.8 (360) 


7.0 (400) 


6.2 (360) 


20 Hz 


6.2 (220) 


5.6 (220) 


4.9 (200) 


ET 


1 Hz 


71 (3000) 


64 (3000) 


56 (3000) 


5 Hz 


52 (800) 


47 (800) 


41 (730) 


10 Hz 


41 (440) 


37 (440) 


32 (400) 



LISA 



10-4 Hz 5.9 (4.8 X 10^) 5.4 (4.8 x 10^) 4.7 (4.3 x 10^) 



TABLE III. Best bounds on Xg (in units of 10^^ km for the case of 
Adv. LIGO and ET, and 10^^ km for LISA) obtained from various 
combinations of mass ratio r\ and low-frequency cutoff /ow Total 
mass values (in Mq) giving the best bound are shown in brackets. 



Another concern is the detectability of signals deformed 
by the propagation effect of the massive graviton by GR- 
based templates. In order to address this question (indeed 
partially), we have computed the fitting factor (fraction of op- 
timal SNR recovered by a suboptimal template family) iDlll 
of the GR-based IMR templates with signals from equal-mass 
binaries (in the mass range 20 — 2OOOM0, located at IGpc) in 
Adv. LIGO, assuming different values for the graviton mass. 
If we assume the constraints on the graviton mass given by so- 
lar system tests (Ag = 2.8 x 10^^ km), the fitting factor is unac- 
ceptably low (0.5 - 0.93). However, if the mass of the graviton 
is a factor of three smaller than the solar system limit, then the 
fitting factors are greater than 0.97. This dramatic change is 
due to the fact that the deformation of the observed signal is 
proportional to the square of the Compton wavelength (see 
Eq.Q. 



E. Limitations of this work 

Due to the lack of a complete massive graviton theory, we 
have considered only the propagation effects of a massive 
graviton, and have assumed that the wave generation is cor- 
rectly given by GR. If BHs in the true massive-graviton theory 
are significantly different from the BHs in GR, this could af- 
fect our estimates. Additionally, we have considered only the 
leading-harmonic gravitational waveforms (in GR) produced 
by non- spinning BH binaries. For the case of binaries with 
high mass ratios, a considerable fraction of the emitted energy 
is deposited in the higher harmonics (see, e.g., |[52ll ). Also, the 
current understanding is that most of the BHs in nature may be 
spinning, with possibly high spin magnitudes (see, e.g., 11531 - 
[55II ). This imperfect description of the model waveforms can 
introduce systematic errors in the estimated parameters (see, 
e.g., |[56ll ). including in the massive graviton bounds, which 
this paper does not try to address. 

In this paper, the error bounds are estimated by means of 
the Fisher information matrix approach. This approach has a 
number of limitations (see e.g., |57l] and |58t] for a discussion), 
including the fact that this is valid only in the limit of large 
SNRs, does not include various priors in the parameters (such 
as T] G (0,0.25]), nor the known issues involved in real data 
analysis pipelines. These limitations are better addressed by 
techniques like Markov-Chain Monte-Carlo methods. 



We emphasize that currently there is no observational evi- 
dence for stellar-mass black holes having mass greater than ~ 
3OM0. Although a recently discovered ultra-luminous X-ray 
source ||4Q|i represents a possible detection of a black hole with 
mass ~ 500 M0, observational evidence for intermediate-mass 
(- 100 - lO'^Mo) black holes is still under debate IHl SI]. 
However, population synthesis studies have suggested a num- 
ber of channels through which black-hole binaries with total 
mass - 30 - lO'^M© could form lilfioll. Although the coa- 
lescence rates of these binaries are highly uncertain, advanced 
detectors might be able to detect several of such events per 
year [i5QL 
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